Spanish generation from Spanish Sign Language using a phrase-based translation system

This paper describes the development of a Spoken Spanish generator from Spanish Sign Language (LSE – Lengua de Signos Española) in a specific domain: the renewal of Identity Document and Driver’s license. The system is composed of three modules. The first one is an interface where a deaf person can specify a sign sequence in sign-writing. The second one is a language translator for converting the sign sequence into a word sequence. Finally, the last module is a text to speech converter. Also, the paper describes the generation of a parallel corpus for the system development composed of more than 4,000 Spanish sentences and their LSE translations in the application domain. The paper is focused on the translation module that uses a statistical strategy with a phrase-based translation model, and this paper analyses the effect of the alignment configuration used during the process of word based translation model generation. Finally, the best configuration gives a 3.90% mWER and a 0.9645 BLEU

Evaluating a Speech Communication System for deaf people

This paper describes the development of an Advanced Speech Communication System for Deaf People and its field evaluation in a real application domain: the renewal of Driver’s License. The system is composed of two modules. The first one is a Spanish into Spanish Sign Language (LSE: Lengua de Signos Española) translation module made up of a speech recognizer, a natural language translator (for converting a word sequence into a sequence of signs), and a 3D avatar animation module (for playing back the signs). The second module is a Spoken Spanish generator from sign-writing composed of a visual interface (for specifying a sequence of signs), a language translator (for generating the sequence of words in Spanish), and finally, a text to speech converter. For language translation, the system integrates three technologies: an example-based strategy, a rule-based translation method and a statistical translator. This paper also includes a detailed description of the evaluation carried out in the Local Traffic Office in the city of Toledo (Spain) involving real government employees and deaf people. This evaluation includes objective measurements from the system and subjective information from questionnaires. Finally, the paper reports an analysis of the main problems and a discussion about possible solutions

Sistema de Comunicación Oral para Personas Sordas

Este artículo describe el desarrollo y la evaluación de un sistema de comunicación para personas sordas en un ámbito de aplicación específico: la renovación del permiso de conducir. El sistema de comunicación desarrollado está compuesto por dos módulos que permiten la comunicación en los dos sentidos. El primer módulo es un traductor de voz en castellano a Lengua de Signos Española (LSE) y está formado por un reconocedor de voz, un traductor de palabras en castellano a una secuencia de signos y un tercer módulo de representación de los signos mediante un agente animado. El segundo módulo es un generador de voz en castellano a partir de una secuencia de signos, y está formado por una interfaz donde se especifican los signos, un traductor (para convertir la secuencia de signos en una secuencia de palabras) y un conversor de texto a voz. En los dos módulos de traducción entre lenguas, se integran tres tecnologías: una basada en ejemplos, una basada en reglas y un traductor estadístico. Este artículo describe la evaluación del sistema llevada a cabo en la Jefatura Provincial de Tráfico de Toledo implicando a funcionarios de dicha jefatura y personas sordas

Language Resources for Spanish - Spanish Sign Language (LSE) translation

This paper describes the development of a Spanish Spanish Sign Language (LSE) translation system. Firstly, it describes the first Spanish Spanish Sign Language (LSE) parallel corpus focused on two specific domains: the renewal of the Identity Document and Driver’s License. This corpus includes more than 4,000 Spanish sentences (in these domains), their LSE translation and a video for each LSE sentence with the sign language representation. This corpus also contains more than 700 sign descriptions in several sign writing specifications. The translation system developed with this corpus consists of two modules: a Spanish into LSE translation module that is composed of a speech recognizer (for decoding the spoken utterance into a word sequence), a natural language translator (for converting a word sequence into a sequence of signs) and a 3D avatar animation module (for playing back the signs). The second module is a Spanish generator from LSE made up of a visual interface (for specifying a sequence of signs in sign writing), a language translator (for generating the sequence of words in Spanish) and a text to speech converter. For each language translation, the system uses three technologies: an example based strategy, a rule based translation method and a statistical translator

Advanced Speech Communication System for Deaf People

This paper describes the development of an Advanced Speech Communication System for Deaf People and its field evaluation in a real application domain: the renewal of Driver’s License. The system is composed of two modules. The first one is a Spanish into Spanish Sign Language (LSE: Lengua de Signos Española) translation module made up of a speech recognizer, a natural language translator (for converting a word sequence into a sequence of signs), and a 3D avatar animation module (for playing back the signs). The second module is a Spoken Spanish generator from sign writing composed of a visual interface (for specifying a sequence of signs), a language translator (for generating the sequence of words in Spanish), and finally, a text to speech converter. For language translation, the system integrates three technologies: an example based strategy, a rule based translation method and a statistical translator. This paper also includes a detailed description of the evaluation carried out in the Local Traffic Office in the city of Toledo (Spain) involving real government employees and deaf people. This evaluation includes objective measurements from the system and subjective information from questionnaire

Estudio del tipo de alineamiento en un sistema de traducción estadística de castellano a Lengua de Signos Española (LSE)

La principal aportación de este artículo es el estudio del efecto que tiene el tipo de alineamiento en un sistema de traducción estadística de castellano a Lengua de Signos Española (LSE). El sistema de traducción utiliza un modelo de traducción basado en subfrases o secuencias de palabras. El artículo describe el ajuste de los parámetros de configuración de este sistema para el problema de traducción concreto (castellano-LSE), siendo la selección del tipo de alineamiento un aspecto crítico en los resultados de traducción obtenidos. La selección del tipo de alineamiento se define en el proceso de generación del modelo de traducción basado en palabras como paso previo a la generación del modelo de secuencias de palabras. La evaluación de la arquitectura se realiza con varias métricas: WER (tasa de error de palabras), BLEU (“BiLingual Evaluation Understudy”) y NIST. Finalmente, los resultados que se obtienen dan una tasa de error de 28,29%, consiguiendo una reducción relativa de más de un 35% en dicha tasa de error

Sistema de traducción de lenguaje SMS a castellano

En este artículo se describe el proceso llevado a cabo para desarrollar un sistema de traducción de lenguaje SMS (Short Message Service) a castellano. En primer lugar, se genera una base de datos necesaria para desarrollar el sistema, formada por más de 11000 términos y expresiones en lenguaje SMS y sus traducciones al castellano, así como frases de ejemplo en lenguaje SMS para realizar una primera evaluación del sistema. La arquitectura completa está formada por un traductor automático estadístico basado en subfrases o secuencias de palabras y una serie de funciones implementadas para actuar sobre las frases en tiempo real. La evaluación de la arquitectura se realiza con las siguientes métricas: WER (tasa de error de palabras), BLEU (“BiLingual Evaluation Understudy”) y NIST. Como resultado final, se obtiene una tasa de error de palabra de 20,2% para el mejor experimento

Impaired Innate Immunity in Tlr4−/− Mice but Preserved CD8+ T Cell Responses against Trypanosoma cruzi in Tlr4-, Tlr2-, Tlr9- or Myd88-Deficient Mice

The murine model of T. cruzi infection has provided compelling evidence that development of host resistance against intracellular protozoans critically depends on the activation of members of the Toll-like receptor (TLR) family via the MyD88 adaptor molecule. However, the possibility that TLR/MyD88 signaling pathways also control the induction of immunoprotective CD8+ T cell-mediated effector functions has not been investigated to date. We addressed this question by measuring the frequencies of IFN-γ secreting CD8+ T cells specific for H-2Kb-restricted immunodominant peptides as well as the in vivo Ag-specific cytotoxic response in infected animals that are deficient either in TLR2, TLR4, TLR9 or MyD88 signaling pathways. Strikingly, we found that T. cruzi-infected Tlr2−/−, Tlr4−/−, Tlr9−/− or Myd88−/− mice generated both specific cytotoxic responses and IFN-γ secreting CD8+ T cells at levels comparable to WT mice, although the frequency of IFN-γ+CD4+ cells was diminished in infected Myd88−/− mice. We also analyzed the efficiency of TLR4-driven immune responses against T. cruzi using TLR4-deficient mice on the C57BL genetic background (B6 and B10). Our studies demonstrated that TLR4 signaling is required for optimal production of IFN-γ, TNF-α and nitric oxide (NO) in the spleen of infected animals and, as a consequence, Tlr4−/− mice display higher parasitemia levels. Collectively, our results indicate that TLR4, as well as previously shown for TLR2, TLR9 and MyD88, contributes to the innate immune response and, consequently, resistance in the acute phase of infection, although each of these pathways is not individually essential for the generation of class I-restricted responses against T. cruzi